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DETAILED ACTION 

1 . This action is responsive to communications: Amendment filed 1 1/17/2006. 

2. Claims 1-14 are pending. Claims 1, 7, and 10 are independent claims. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C, 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

4. Claims 1-5, 7-9, 13, and 14 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Escobar et al. (hereinafter "Escobar"), U.S. Patent No. 5,659,793 
issued August 1997. 

Regarding independent claim 1, Escobar teaches an editing system 
comprising a timeline interface having at least one interactive track for interactive 
content and at least one track for time-based media, wherein interactive content may be 
associated with a point in time on the at least one track for interactive content; since 
Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col..4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in the association of media with a point in time on at least one track for interactive 
content. 



Application/Control Number: 09/838,782 Page 3 

Art Unit: 2176 

Escobar teaches means for allowing a user to place interactive content on the at 
least one interactive track according to a selection of whether the interactive content is 
placed on the at least one interactive track either at a single point in time with a locator 
object, wherein a locator object is an object that is attached to a source clip object in the 
timeline at a specified single point in time on the clip (col. 10, 1. 10-36), since Escobar 
teaches that an icon is used as a locator object and is dragged and dropped by the user 
onto the selected timeline track at the start time desired (col. 10, 1. 21-26), and Escobar 
teaches that the icon locator object is attached to a source clip object (col. 10, 1. 10-36; 
col. 10, 1. 58-col. 12, 1. 15), which are called asset objects by Escobar. 

Dependent claim 2 cites: The editing system of claim 7, further comprising: a 
bin for storing interactive content; 

means for importing interactive content into the bin such that interactive content 
is represented by an object in the bin, wherein the object is associated with a unique 
reference to the interactive content, and wherein information describing the interactive 
content is stored as an attribute of the object; 

Escobar teaches a bin for storing interactive content (Col. 6, I. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template (Col. 9, 1. 20-45); compare to and wherein information 
describing the interactive content is stored as an attribute of the object. Files are stored 
in industry standard format (Col. 7, I. 52-56). Because files are stored in industry 
standard format, it is inherent in the disclosure of Escobar that the file is associated with 
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a unique reference, as industry standard format requires the unique identification of 
files. 

Dependent claim 2 further cites: wherein the means for allowing a user to place 
interactive content on the at least one interactive track accesses objects representing 
the interactive content from the bin; and means for updating the information describing 
the interactive content stored as an attribute of the object in the bin by accessing the 
interactive content using the unique reference in response to the user invoking a refresh 
operation, 

Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
(Col. 10, 1. 10-36). Escobar teaches displaying accessing objects representing the 
interactive content from the bin, represented by icons, in Fig. 5E and Fig. 5H. Escobar 
also teaches a method of updating properties of the interactive content in the IDL by 
accessing the interactive content, using the file reference, in response to a refresh 
operation (col. 10, 1. 37-58 especially lines 55-58). Escobar teaches a means of editing 
objects in the bin, making changes to the object, and saving the revised properties for 
the object (Col. 9, I. 45-63). 

Dependent claim 3 cites: The editing system of claim 2, wherein the interactive 
content is a trigger element and the unique reference includes a file name for a trigger 
file including a description of the trigger element and a unique identifier of the trigger 
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element 

Escobar teaches the creation and use of program objects, i.e., trigger files, to perform a 
variety of functions, which can be dragged and dropped onto interactive tracks (Col. 8, I. 
29-67). The objects are stored and edited in the same manner as other objects stored 
in the bins. Escobar also teaches a method for storing a pointer to objects dropped on 
the timeline so that memory can be accessed to obtain the records referenced by the 
pointers at runtime (Col. 10, I. 24-26, I. 37-45). 

Dependent claim 4 cites: The editing system of claim 2, wherein the interactive 
content is a document and the unique reference includes a file name for the document, 
Escobar teaches the creation of graphics or text overlay assets, i.e., documents with a 
graphic/text editor (Col. 9, I. 64-Col. 10, 1. 9). Escobar teaches that files are stored in 
industry standard format (Col. 7, 1. 52-56). Because files are stored in industry standard 
format, it is inherent in the disclosure of Escobar that the file is associated with a file 
name, as industry standard format requires the naming of files. 

Dependent claim 5 cites: The editing system of claim 1, further comprising: a 
bin for storing interactive content; means for importing interactive content into the bin 
such that information about the interactive content is stored in the bin; wherein the 
means for allowing a user to place interactive content the at least one interactive track 
stores information about the interactive content as an attribute of the object used for the 
interactive content. 
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Escobar teaches a bin for storing interactive content (Col. 6, 1. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template, so that information about the content is stored in the bin 
(Col. 9, 1. 20-45). Fig. 6 of Escobar discloses timeline management where a data 
structure is associated with each timeline track; the structure is a linked list, and each 
entry in the list points to another data structure, which contains the information 
necessary to execute the object on the timeline (Col. 11,1. 30-35). This data structure 
stores information about the object as an attribute. 

Independent claim 7 cites: An editing system comprising: a timeline interface 
for specifying a program having at least one interactive track for interactive content and 
at least one track for time-based media, wtierein interactive content may be associated 
with a point in time on the at least one interactive track; 

Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col. 4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in time-based media. Escobar teaches the application of a time code to allow an edit 
point to be defined as a certain duration from a clearly delineated starting point for asset 
playback (Col. 8, 1. 1 5-21 ). Escobar teaches that the user interface allows the user to 
associate properties with an object, including creating placeholder objects, and to 
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assemble objects into applications with relative timing specified by their placement 
along the timeline tracks (Col. 6, 1. 30-41). 

Claim 7 also cites: a bin for storing interactive content; 

means for importing interactive content into the bin sucli that interactive content 
is represented by an object in the bin, wherein the object is associated with a unique 
reference to the interactive content, and wherein information describing the interactive 
content is stored as an attribute of the object; 

Escobar teaches a bin for storing interactive content (Col. 6, 1. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template (Col. 9, 1. 20-45); compare to and wherein information 
describing the interactive content is stored as an attribute of the object. Files are stored 
in industry standard format (Col. 7, 1. 52-56). Because files are stored in industry 
standard format, it is inherent in the disclosure of Escobar that the file is associated with 
a unique reference, as industry standard format requires the unique identification of 
files. 

Claim 7 also cites: means for allowing a user to place interactive content 
represented by an object selected from the bin on the at least one interactive track; 
means for allowing a user to edit placement of the interactive content on the at least one 
interactive track and 

Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
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(Col. 10, 1. 10-36). Escobar teaches means for a user to edit placement on the 
interactive track (col. 10, 1. 10-36, esp. I. 23). 

Claim 7 also cites: means for updating the infonriation describing the interactive 
content stored as an attribute of the object in the bin by accessing the interactive 
content using the unique reference in response to the user invoking a refresh operation. 
Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
(Col. 10, 1. 10-36). Escobar teaches displaying accessing objects representing the 
interactive content from the bin, represented by icons, in Fig. 5E and Fig. 5H. Escobar 
also teaches a method of updating properties of the interactive content in the IDL by 
accessing the interactive content, using the file reference, in response to a refresh 
operation (col. 10, 1. 37-58 especially lines 55-58). Escobar teaches a means of editing 
objects in the bin, making changes to the object, and saving the revised properties for 
the object (Col. 9, 1. 45-63). 

Regarding dependent claims 8 and 9, claims 8 and 9 reflect the same 
concepts described in the editing system as claimed in claims 3 and 4, and are rejected 
along the same rationale. 

Regarding dependent claim 13, Escobar also teaches a method of updating 
properties of the interactive content in the IDL by accessing the interactive content, 
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using the file reference, in response to a refresh operation (col. 10, 1. 37-58 especially 
lines 55-58). Therefore, Escobar teaches a means of editing objects in the bin, making 
changes to the object, and saving the revised properties for the object in the IDL (Col. 9, 
1. 45-63). 

Regarding dependent claim 14, claim 14 is directed toward substantially similar 
subject matter as claimed in claim 13, and is rejected along the same rationale. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, If the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 6 and 10-12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar, and further in view of Kanda, U.S. Patent No. 
6,324,335 issued November 2001. 

Regarding dependent claim 6, Escobar teaches a multinnedia application 
development tool, which includes graphics or text overlays, i.e., information to be 
displayed with video (Col. 8, I. 64-Col. 10, I. 9). Escobar teaches a means for playing 
back the program created with the timeline with an intelligent terminal or set top box or 
digital entertainment terminal (Col. 12, 1. 16-Col. 15, 1. 26). Escobar teaches a graphics 
display generator and video RAM that manipulate different planes of active video 
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information (Col. 13, 1. 35-Col. 14, 1. 4). Escobar does not explicitly teach a specification 
of size and spatial position of the video relative to the information to be displayed in the 
display, or means for accessing the specification of the size and spatial position of the 
video for the interactive content corresponding to a point in time in the program, 
however, Kanda teaches data showing the size and spatial position of the video relative 
to the information displayed on the display (col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). 

Escobar does not explicitly teach a means for displaying the video and the 
display information of the interactive content according to the specification of the size 
and spatial position of the video relative to the information to be displayed in the display 
and the point in time in the program, however, Kanda teaches displaying the size and 
spatial position of the video relative to the information displayed on the display (Fig. 3; 
col. 17, I. 35-52; col. 17, I. 53-coL 18, I. 14). 

Both Escobar and Kanda are directed toward video editing systems. It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply 
Kanda to Escobar so that the user would have the benefit of an editing system capable 
of high speed real time edition and having improved usability (Kanda, Col. 1, 1. 44-46). 

Independent claim 10 cites: An editing system comprising: a timeline interface 
for specifying a program having at least one interactive track for interactive content and 
at least one track for video, wherein interactive content may be associated with a point 
in time on the at least one interactive track; 
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Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col. 4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in time-based media. Escobar teaches the application of a time code to allow an edit 
point to be defined as a certain duration from a clearly delineated starting point for asset 
playback (Col. 8, 1. 15-21). Escobar teaches that the user interface allows the user to 
associate properties with an object, including creating placeholder objects, and to 
assemble objects into applications with relative timing specified by their placement 
along the timeline tracks (Col. 6, 1. 30-41). 

Claim 1 0 also cites: means for allowing a user to place interactive content on the 
at least one interactive track, wherein interactive content includes display information 
indicating information to be displayed in a display with the video from the at least one 
track for video, and a specification of size and spatial position of the video relative to the 
information to be displayed in the display; and 

Escobar teaches a process by which the user views the contents of the bin of interactive 
content and the user selects an icon from the bin for placement on the timeline, and 
selects the timeline track on which the icon is to be placed, then drags and drops the 
icon at the start time desired (Col. 10, I. 10-36). Escobar teaches a multimedia 
application development tool, which includes graphics or text overlays, i.e., information 
to be displayed with video (Col. 8, 1. 64-Col. 10, 1. 9). 
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Escobar does not explicitly teach that the interactive content includes a 
specification of size and position of the video, however, Kanda teaches data showing 
the size and spatial position of the video relative to the information displayed on the 
display (col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). Kanda also teaches displaying the 
size and spatial position of the video relative to the information displayed on the display 
(Fig. 3; col. 17, I. 35-52; col. 17, I. 53-col. 18, 1. 14). Both Escobar and Kanda are 
directed toward video editing systems. It would have been obvious to one of ordinary 
skill in the art at the time of the invention to apply Kanda to Escobar so that the user 
would have the benefit of an editing system capable of high speed real time edition and 
having improved usability (Kanda, Col. 1, 1. 44-46). 

Claim 1 0 also cites: means for playing back the program specified by the 
timeline interface including: means for accessing the specification of the size and spatial 
position of the video for the interactive content corresponding to a point in time in the 
program; and means for displaying the video and the display information of the 
interactive content according to the specification of the size and spatial position of the 
video relative to the information to be displayed in the display and the point in time in 
the program. 

Escobar does not explicitly teach a means for accessing and displaying the video 
and display information according to the specification and the point in time in the 
program, however, Kanda teaches data showing the size and spatial position of the 
video relative to the information displayed on the display (col. 17, 1. 35-52; coL 17, 1. 53- 
col. 18, 1. 14). Kanda also teaches displaying the size and spatial position of the video 
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relative to the information displayed on the display (Fig. 3; col. 17, 1. 35-52; col. 17, 1. 53- 
col. 18, 1. 14). Both Escobar and Kanda are directed toward video editing systems. It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
apply Kanda to Escobar so that the user would have the benefit of an editing system 
capable of high speed real time edition and having improved usability (Kanda, Col. 1, 1. 
44-46). 

Dependent claim 11 cites: The editing system of claim 10, further comprising: 
means for allowing a user to select interactive content; 

Escobar teaches a means for a user to select an object of interactive content from a bin 
using icons (Col. 10, 1. 10-36). 

means for launching an authoring tool corresponding to the selected interactive 
content and for causing the authoring tool to access and open for editing the selected 
interactive content, 

Escobar teaches a software architecture which launches the authoring tool (Fig. 3, Col. 
7, 1. 57-65), and a development environment utilized to create interactive multimedia 
applications (Col. 7, 1. 17-29). The tool is used to access and open the interactive 
content. 

Dependent claim 12 cites: The editing system of claim 10, further comprising: 
means for allowing the user to place time-based media on a track using one of a source 
clip object and a locator object; and 
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Escobar teaches a method of placing an icon on a selected timeline track at a desired 
start time (Col. 10, 1. 15-36). The icon represents an object, which may be an edited 
section of raw video, i.e., a source clip object (Col. 9, 1. 46-63). A pointer to the object 
identified by the icon on the timeline track is then stored in a linked list for the selected 
timeline track at a location determined by its start time (Col. 10, 1. 24-26), therefore the 
pointer is a locator object. 

means for allowing the user to perform editing operations that affect source clip 
objects and locator objects, whereby interactive content and time-based media are 
edited in the same manner to maintain synchronization, 

Escobar teaches that objects may be created to permit easy manipulation of portions of 
an asset during creation of a specific application, while other objects are more functional 
and may be reused. Escobar discloses video objects, audio objects, text/graphical 
objects, special effects, program objects and applications (Col. 6, 1. 52-61). The user 
performs editing operations in a work space where currently selected objects may be 
displayed and edited (Fig. 1 , Col. 6, 1. 6-29). Escobar teaches that the objects are 
edited in the same manner (Col 9, 1. 20-Col. 10, 1.35). 

Response to Arguments 

Applicant's arguments filed 1 1/17/2006 have been fully considered but they are 
not persuasive. In regard to independent claim 1 , applicant argues that Escobar does 
not teach the limitations ...fAve interactive content is placed on the at least one interactive 
track either at a single point in time with a locator object.. or at a point in time with a 



Application/Control Number: 09/838,782 Page 15 

Art Unit: 2176 

duration with a source clip object (Remarks, p. 7, par. 3). First, because the claim 
limitation uses the phrasing "either... or", the first limitation has been addressed in the 
rejection of claim 1 above, and therefore the second limitation, or at a point in time with 
a duration with a source clip object, and the corresponding arguments submitted by 
applicant, are moot. In response to applicant's arguments regarding the limitation the 
interactive content is placed on the at least one interactive tracl< either at a single point 
in time with a locator object Escobar does teach means for allowing a user to place 
interactive content on the at least one interactive track according to a selection of 
whether the interactive content is placed on the at least one interactive track either at a 
single point in time with a locator object, wherein a locator object is an object that is 
attached to a source clip object in the timeline at a specified single point in time on the 
clip (col. 10, 1. 10-36), since Escobar teaches that an icon is used as a locator object 
and is dragged and dropped by the user onto the selected timeline track at the start time 
desired (col. 10, 1. 21-26), and Escobar teaches that the icon locator object is attached 
to a source clip object (col. 10, 1. 10-36; col. 10, 1. 58-col. 12, 1. 15), which are called 
asset objects by Escobar. 

Applicant refers to the Specification, p. 8, 1. 23-26 to define a locator object, an 
object attached to a clip in the timeline at a specified point in time on the clip; and 
source clip object, an object which references a clip in a bin and has a start position and 
duration in the track (Remarks, p. 7, par. 3). It is the examiner's opinion that the 
disclosure of Escobar teaches source clip and locator objects as cited above, at col. 10, 
I. 10-36; col. 10, 1. 58-col. 12, 1. 15, since Escobar teaches that source clip objects are 
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media placed on the timeline, and the icon is placed at a specific point in time on the 
clip. 

In response to applicant's arguments regarding independent claim 7 (Remarks, 
p. 8), applicant argues that Escobar does not teach the limitations, interactive content is 
represented by an object in tlie bin, wtierein tiie object is associated with a unique 
reference to tlie interactive content, and wherein information describing the interactive 
content is stored as an attribute of the object; 

and: means for updating the information describing the interactive content stored 
as an attribute of the object in the bin by accessing the interactive content using the 
unique reference in response to the user invoking a refresh operation 
However, Escobar does teach a method of updating properties of the interactive content 
in the IDL by accessing the interactive content, using the file reference, in response to a 
refresh operation (col. 10, I. 37-58 especially lines 55-58). While applicant argues that 
because Escobar teaches an IDL which is a text file that combines all the linked lists 
representing each track of the multimedia presentation, applicant's arguments do not 
address the disclosures of Escobar which teach that the IDL is updated in response to 
each user edit decision, and provides the associations and unique references between 
objects, interactive content, and attributes (col. 10, 1. 10-57), and therefore Escobar 
does teach each and every limitation of claim 7. 

7. In response to applicant's arguments regarding claims 6 and 10-12 (Remarks, p. 
9-10), contrary to applicant's arguments, Kanda does teach. data showing the size and 
spatial position of the video relative to the information displayed on the display (col. 17. 
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I. 35-52; col. 17, 1. 53-col. 18, 1. 14). Kanda also teaches displaying the size and spatial 
position of the video relative to the information displayed on the display (Fig. 3; col. 17, 
I. 35-52; col. 17, 1. 53-col. 18, 1. 14). Kanda does teach a specification of size and 
spatial position of the video relative to the information to be displayed in the display 
(Claim 10), at col. 17, 1. 53-col. 18, 1. 14. 

Conclusion 

8. THIS ACTION IS MADE FINAL Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Amelia Rutledge whose telephone number is 571-272- 
7508. The examiner can normally be reached on Monday - Friday 9:30 - 6:00. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner^s 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published -applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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